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Abstracts 

English 

This study is based on the analysis of academic results of 692 undergraduate and graduate students in two 
disciplines in a French university who attended their courses using one out of four possible learning 
modalities. Within the two disciplines, Art History and Educational Sciences, students chose between 
face-to-face learning (on campus), paper-based distance learning (correspondence), Web-based distance 
learning (e-leaming) or a blend of Web-based and face-to-face learning (combined) modalities. 
Comparison, using two indicators of overall academic success between the four learning modality types was 
conducted. The analyses revealed that e-learners attending at least one course on-campus (combined 
modality) did just as well as students attending all their courses using the on-campus only modality. 
Furthermore, depending on the discipline, e-learners' academic success was higher than correspondence 
learners', albeit not as high as on-campus and combined learners' achievements. 

French 

Cette etude porte sur l'analyse de la reussite universitaire des etudiants de licence et de master premiere 
annee en fonction de differentes modalites de formation (universite frangaise) et de deux disciplines 
(histoire de Part et sciences de l'education). Quatre modalites de formation ont ete prises en compte : en 
presence, a distance par correspondance postale, a distance via une plateforme Internet et en presence 
augmentee par l'utilisation d'une plateforme Internet (LMS). Les analyses prenaient en compte le 
dispositif de formation dans sa globalite ce qui permettait d'estimer l'impact d'un mode de suivi mixant des 
unites en presence et a distance. Les resultats permettent de conclure que les etudiants totalement a 
distance reussissent moins bien que ceux en presence. Les etudiants en presence qui suivent certaines de 
leurs unites totalement en e-learning ont des resultats equivalents a ceux qui suivent toutes leurs unites en 
presence. Par contre, en fonction de la discipline, le e-leaming permet d'attenuer l'impact negatif sur la 
reussite aux examens dans le cadre d'un enseignement totalement a distance. 
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Introduction 


Information and communication technologies (ICTs) have penetrated increasingly into university courses 
since the 1990s in France, as elsewhere. Reports from the USA have shown an increasing share of Internet 
use in teaching, mainly in distance education (Wirt et al. 2004; National Center for Education Statistics 
2002). Nevertheless, if the technology potentially can facilitate diverse forms of teaching, several 
researchers have questioned the pertinence of such novelty (Fenouillet and Dero 2006; Albero 2004; 
Phipps andMerisotis 1999). 

Although distance education facilitates access to university courses for specific categories of the population 
(employees, geographically removed students, to give just a couple of examples) distance education has 
been considered since its beginning as an alternative to face-to-face learning and not as a learning modality 
in its own right. Numerous studies have pointed to the limits of this substitute to face-to-face forms of 
learning. It occurs for example, that the dropout rate of distance learners is much higher in comparison to 
students in face-to-face settings. (Carr 2000; Diaz 2000; Easterday 1997; Roblyer 1999). A study that was 
conducted by Vergidis and Panagioutakopoulos (2002) at the Hellenic Open University in Greece shows 
that several factors are related to this, such as professional activity or a miscalculation by students of time 
they can devote to their learning. Indeed, people engaged in distance learning do not have the same 
constraints as those studying in face-to-face settings. Nevertheless, Pascarella and Terenzini (1980) have 
shown that students that have frequent contact with the university in which they are enrolled (and in 
particular informal contact), present a lower dropout rate. Internet, with the communication means that 
are part of it (e-mail, instant messaging, forums etc.), appears to introduce non-negligible progress in 
respect to distance education that takes place solely using postal services. 

Enthusiasm is often connected to the advent of newer practices, mainly those emerging from 
asynchronous services such as e-mail, forums, file exchange. Asynchronous communication enables 
students to turn to resources at their own pace and above all to take the needed time for reflection, when 
they reply to an e-mail or to a forum post, for example. For Spencer and Hiltz (2001), asynchronous 
learning is superior to other forms of purely synchronous learning on several criteria. This conclusion can 
be considered in the light of conclusions arrived at in numerous other studies in the narrower framework 
of computer-based instruction, or to those several hundred studies that have been the object of 
meta-analyses (Cavanaugh 2001; Cavanaugh et al. 2004; Clark 1985; Liao and Bright 1991; Lipsey and 
Wilson 1993; Waxman et al. 2003). These studies point to positive effects that different forms of 
technology have on learning. Nonetheless, they are primarily concerned with computer-based instruction 
and not with the use of Internet for learning. Moreover, even at this level, authors are far from being 
unanimous as some find the effect of technology as such to be nil (i.e. the media has no impact) and when 
effect is found, it is attributed to pedagogical methods embedded in the tools (Clark 1983, 1985, 1994; 
Gagne et al. 1992; Joy and Garcia 2000). Fenouillet and Dero (2006) use different criteria enabling a finer 
grained conclusion through results of 34 studies comparing face-to-face with online courses. Criteria used 
were exam grades, knowledge level tests, student satisfaction and dropout rates. 


Online and face-to-face courses generally appear equivalent when comparing exam scores. At odds, learner 
satisfaction tends to be higher in face-to-face settings. As to student dropout, a small number of studies 
points to a higher dropout rate in face-to-face settings. 
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Nevertheless, as Phipps and Merisotis (1999) have noted, comparisons that attempt to clearly reveal the 
superiority of online learning over face-to-face learning pose countless methodological pit-holes. One of 
the most notable of which is that the use of Internet enables to introduce blended learning modes that 
combine both face-to-face and distance learning. Haeuw et al. (2001) suggest a continuum of technology 
use at which at one end technology is present in face-to-face learning whilst at the other it is used entirely 
at a distance. In effect, ICT in education can be used in different proportions between these extremes 
making it difficult to distinguish between educational designs. Haeuw et al. (2001) introduce no less that 
three intermediary learning forms that can be considered as blended. In this sense blending is considered 
within the same course. At the same time one can point to the fact that blending can take place within 
curricula in general. One course can be taught face-to-face while another may be delivered at a distance 
over Internet. The combination between both modes presents the advantage of implicating students in 
campus life even when they are following most of their studies at a distance. Considering this, it is possible 
to hypothesize that mixing these in the program can enable breaking student isolation when learning at a 
distance, to a greater deal than ICT tools would, as have noted Pascarella and Terenzini (1980) in the 
framework of partially-based distance learning using postal services. 

The terminological abundance that is presently in use to designate online learning translates the relatively 
new difficulty in characterizing the nature of different designs. The same educational design may be 
considered as open and distance learning (ODL), as e-training, e-learning, blended learning, self-education 
or even e-teaching. Beyond terminological nuances we will be using the term e-leaming. In our study, 
which this paper presents, two seemingly essential aspects impact learning and academic success. The first 
is distinguishing learning that takes place in part from learning that takes place entirely at a distance. The 
second is the type of media being used to access information. It may either be fully electronic, using ICTs, 
or be paper-based using postal services which, in our case, was not intended to enable interaction with the 
instructor or with other students. 

Added to the complexity inherent in the multiplication of possibilities that technologies offer, there is 
another no less complex dimension to consider which is the discipline. In teaching mathematics, Smith and 
Ferguson (2005) show that student dropout rate is significantly higher when e-learning is used on its own, 
in comparison to other disciplines taught that way. Whereas dropout rates in face-to-face designs are 
similar between disciplines (insignificant differences). For the authors (Smith and Ferguson 2005), the 
discrepancy is explained by the inadequacy of tools used in e-leaming for teaching mathematics. Smith et 
al. (2008) in another study suggest that the problem of using Internet-based tools in respect to different 
disciplines is much larger and does not pertain only to mathematics. Smith et al. (2008) base their work on 
Biglan's (1973) classification, arrived at after having addressed academic teaching staff in 30 disciplines 
who were asked to order disciplines by domain proximity. This classification made it possible to establish 
groups of fields of study that are organized on different dimensions. The most known grouping is no doubt 
the one based on hard sciences (physics, chemistry, mathematics, botany etc.) and soft sciences 
(philosophy, sociology, psychology etc.). Another grouping enables distinguishing between theoretical 
sciences (for example; physics and mathematics for hard sciences, or history and philosophy for soft 
sciences) from applied sciences (for example; mechanical engineering and medicine for hard sciences, or 
educational sciences and finance for soft sciences). It appears that values, objectives, perspectives that are 
underpinning these dimensions are not the same which leads to notably different use of services 
implemented in electronic platforms or learning (content) management systems [LMS or LCMS] that are 
used in online courses. Neumann (2001) explains that learning soft sciences relies on more reading time, 
seminars and tutoring whereas learning hard sciences requires hands-on (laboratory) activities with 
preference for exercises and error analysis. Hard sciences have hermetically structured curricula around 
concepts and principles highly linked one to the other while soft sciences are more open and have a much 
more approximate organization. Instruction in hard sciences attaches more importance to learning facts, 
principles and concepts whereas soft sciences summon more general knowledge, reflection, critical 
thinking and creativity. 

White and Liccardi (2006) put forward the idea of "technological affordance" that may be a function of the 
activity or process supported or encouraged by a particular technology. For example, technologies that 
favor communication and discursive reasoning (such as forums) can facilitate critical thinking. Several 
studies (Jones et al. 2004; Smith et al. 2008) point to diverging use of digital resources depending on the 
discipline and subject-matter. This affects progression of digital resources usage and networked learning in 
universities. 

Study basis, limits and hypotheses 

The study relies on grades of students in programs from two disciplines in which partaking in courses was 
either through e-learning, postal mail or the more traditional on-campus face-to-face mode. Both domains 
can be classified as soft sciences (Biglan's classification 1973). Whilst one of them represents applied 
sciences (Educational Sciences), the other represents theoretical sciences (Art History). 

The end of year results are indicators reflecting academic success. The data are relatively complex to 
analyze as there are at least two types of results: getting credit for the academic year (passing) and the 
average grade obtained by each student across all courses. In order for both to be accounted for, it is 
required that the student completes all courses of both the year's semesters. The fact of not completing all 
courses may be considered as failure by some of the students, while for others this may be part of a more 
global strategy. For example, students who are professionally active in parallel to their studies, who are 
present in great numbers in distance learning courses, may use a strategy of getting credit for courses over 
several years. Such students may decide to get credit for only a few courses during the academic year but 
may end up with excellent results once all courses are completed over several years. Put differently, the fact 
of not completing all courses in one year could be considered as a strategy for success and not failure, 
specifically when the strategy is freely chosen by the student. Therefore, it is important to consider both 
results in order to see if the analyses point to identical conclusions. In addition, assessment in each course 
may vary. Failure grades may be attributed to students that have not handed in mid-semester work in an 
ongoing assessment design. In other cases, credit for a course that relies on handing in a final assignment 
or paper may, if the student does not hand it in, lead to course failure or to the course being designated as 
incomplete. The grade compensation system also makes it possible for a student to fulfil requirement for a 
course without investing in passing it, as other courses will compensate and still make it possible for him or 
her to pass the academic year. Here again, considering these dealings with the university accreditation 
system, it seems worth taking into account students who have failed but who may have played up to the 
system. 

All this indistinctness in the university's assessment system, briefly presented here, makes one aware of 
the inherent limits of the indicators used. University assessment does not truly reflect ability, knowledge or 
students' capacities, but a means for measurement subject to numerous constraints, as any measuring 
apparatus may be subject to. 
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Albeit the numerous limits, the assessment set-up should enable testing some hypotheses. Overall, one 
may expect that academic success in courses taken at a distance will be lower than that of students 
attending courses on campus. However, the weight of any difference must be adjusted by taking two factors 
into account. The first is the presence of blended learning that can take on two forms. Form A is the 
combination of courses, some taken on campus while others being attended wholly online. As Pascarella 
and Terenzini (1980) have demonstrated, this should favor student academic success. Form B where 
blending takes place within a course, in which course design involves both distance learning and 
on-campus sessions. Our hypothesis is that form B of blending does not result in significant difference 
compared with face-to-face only designs as it does not generate student isolation which we might consider 
as adverse. 

The second factor is the use of ICTs. In general, means made available by these should enable to better the 
success of distance learners. Nevertheless, it is hypothesized that this bettering is related to technological 
affordance (White and Liccardi 2006). At this level, the interfaces for theoretical domains such as 
mathematics, require relatively sophisticated underlying technical infrastructures in order to be efficient 
(Smith and Ferguson 2005). The LCMS that was used in our study 1 - 1 ] has not been the object of in-depth 
study to adapt it to different disciplines. However, as the LCMS facilitates communication, it holds greater 
technical affordance for applied sciences (White and Liccardi 2006; Smith et al. 2008). Consequently, it is 
hypothesized that academic success of students who use distance learning in Educational Sciences would 
be higher in comparison to that of students in Art History. 

Finally, it should be noted that both disciplines are not structured the same way. Art History has a relatively 
traditional curricular structure with three years leading to graduation and two extra to a Master's degree. 
Educational Sciences on the other hand, start at third year at undergraduate level (the first two being 
completed in other disciplines); and similarly, two extra years to reach a Master's degree. Also, student 
results taken into account only include the first year at master's level as the second year of post-graduate 
studies in French universities is subject to numerus clausus. All these considerations hence make 
comparison difficult as some correlations are impossible because of discipline specifics. 

Methodology 

The population is made up of 2847 students enrolled at a university in greater Lille during the 2004-05 
academic year. Students enrolled were first, second and third year undergraduates plus first year graduates 
preparing for a master's degree. 

Two disciplines were included in the research, Educational Sciences and Art History. They were chosen 
because of the various learning modalities that were designed into the programs. Students in both 
disciplines attended courses in face-to-face settings, at a distance receiving their course material by Post, or 
used a LCMS. While it is possible to gain access to student grades per course or globally for the academic 
year, the university databases do not enable retrieving reliable information on learning modalities used in 
courses. To obtain the information we needed, we opted for using a questionnaire (taking the opportunity 
of a larger survey conducted by the university on course quality) that we directly addressed to students. We 
then crosschecked the data collected with data we could access in university databases. Students were 
addressed the questionnaire at the end of the first semester (end of January and during February 2005 
before grades were given) according to their primary learning modality. Students studying in face-to-face 
settings were addressed during courses. Correspondence distance learners received the questionnaire by 
Post. E-leamers received a personalized e-mail with a link to an online questionnaire. It should be noted 
that students in Educational Sciences could combine learning modalities. Art Histoiy students, on the 
other hand, could not. They had to choose one singular learning modality out of four available for all their 
courses. The available modalities are defined hereafter: 

• Face-to-face - Students followed all courses on campus with instructors present and without 
computer use. We shall refer to this modality in this paper using the term on-campus students. 

• Paper-based at a distance - Students followed all courses (Art Histoiy) or part of their courses 
(Educational Sciences) at a distance where postal services were used for receiving printed material. 
We shall refer to this modality in this paper using the term correspondence students. 

• E-leaming at a distance - Students followed all courses (Art History) or part of their courses 
(Educational Sciences) at a distance using e-learning. We shall refer to this modality in this paper 
using the term e-learning students. 

• Enhanced face-to-face - Students followed some courses that blended, within the course, 
face-to-face learning and e-learning. We shall refer to this modality in this paper using the term 
combined modes students. 

We were able to use 692 responses to the questionnaire, representing 24.31% of the total population. 406 
were collected using a paper version of the questionnaire and 286 questionnaires were collected using the 
electronic version. The following analyses were sometimes based on lower than the maximum 692 
questionnaires as a result of missing data that led to abandonment of data pertaining to varying numbers of 
individuals, depending on the analysis. 

Table 1. Distribution of Art History learners in respect to the four learning modalities with or without 

parallel on-campus courses 


Learning Modality 

Parallel 

On-Campus 
Courses 

On-Campus 

Correspondence 

E-learning 

Combined Modes 

Total 

No 

0 

108 

55 

0 

163 

Yes 

147 

0 

0 

0 

147 

Total 

147 108 55 0 310 


Table 2. Distribution of Educational Sciences learners in respect to the four learning modalities with or 
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without parallel on-campus courses 


Learning Modality 

Parallel 

On-Campus 
Courses 

On-Campus 

Correspondence 

E-learning 

Combined Modes 

Total 

No 

0 

26 

128 

1 

155 

Yes 

121 

5 

77 

24 

228 

Total 

121 

31 205 25 382 


Proportion of professionally active students 

Being professionally active is one of the factors that may effect student academic success. It is worthwhile 
presenting some analysis results, as data pertaining to this was available. 


Table 3. Distribution of professionally active learners per discipline 


Professional Activity 

Discipline 

Not active 

Occasional 

Regular 

Total 

Art History 

124 

148 

135 

307 

Educational Sc. 

222 

37 

122 

381 

Total 

346 

85 

257 

688 


Table 3 shows that there are more students in Educational Sciences that are professionally active compared 
to Art History students (X 2 (2)=22.14; pc.01). Further analysis indicates that the difference in distribution 
is only true if we compare students studying on campus (X 2 (2)=i8.2i; pc.01). When these comparisons 
are done on distance learning students, correspondence (X 2 (2)=2.s8; ns) or e-learning (X 2 (2)=4.82; ns), 
these differences totally dampen. Generally, when taking into account the proportion of passed, failed or 
incomplete courses students, the non professionally active are more successful than the professionally 
active students (X 2 (4 )=i 8.19; pc.01). On the other hand, if we proceed with the same analysis while this 
time taking into account the average of course grades (grading is based on a o to 20 mark system), this 
difference disappears (F(2, 482)=!..73; ns). The discrepancy between success in terms of passing and 
success in terms of average grade, points to the limits of these analyses which are based on groups in a 
natural setting who are subject to multiple variables. It is nevertheless possible to propose an interpretation 
of these discrepancies. Professionally active students sometimes study for several years using a strategy of 
getting credit by passing chunks of related courses. Once they have gained credit for all required chunks 
they get credit for the academic level. This might explain why there are less professionally active students 
who passed the academic year. On the other hand, once they have ended their studies they attain grades 
comparable to other students which explains the equivalence in grade averages. Obviously, deeper analysis 
would be needed in order to test the validity of these two hypotheses, but that is beyond the scope of this 
presentation. 

Results 


Three major categories of analysis were conducted as a function of the considered data. The first analyses 
were done on the entire population in order to examine results of all students in both disciplines. This level 
enables grasping the differences between academic years of both graduate and postgraduate programs, and 
between disciplines. Thus, making it possible to establish to which point both disciplines are comparable, 
plus the degree to which the sample of students that responded to the questionnaire is representative of 
the population. The two other categories of analysis are discernible from the first, mainly because they 
pertain to the sample of students that responded to the questionnaire. These two categories are themselves 
separate as they each pertain to different result types. The first one takes into account students who passed 
the academic year; whereas the other, students' general average grade. In all analyses, end-of-year results 
were used (over two semesters) as the French system, even though it has recently adopted a graduate - 
postgraduate - doctoral studies system (actually called LMD for Licence - Master - Docteur), still 
functions to a large extent on the principle of annual results. 

Analysis on the entire population 


Table 4. End-of-year results related to academic level in Art History 


Results 


Licence 1 st Year 

Licence 2 n ^ Year 

Licence Year 

Total 

Passed 

n 

171 

113 

95 

379 


% of Row 

45-12 

29.82 

25.07 

100 


% of Column 

22.24 

49-34 

35-19 

29.89 

Failed 

n 

201 

ill 

14 

326 
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% of Row 

61.66 

34-05 

4.29 

100 


% of Column 

26.14 

48.47 

5-19 

25-71 

Incomplete 

n 

397 

5 

161 

563 


% of Row 

70.52 

0.89 

28.60 

100 


% of Column 

5163 

2.18 

59.63 

44.40 

Total 

n 

769 

229 

270 

1268 


% of Row 

60.65 

18.06 

21.29 

100 


% of Column 

100 

100 

100 

100 


Table 5. End-of-year results related to academic level in Educational Sciences 


Results 


Licence 3 r d Year 

Master 1 st Year 

Total 

Passed 

n 

809 

99 

908 


% of Row 

89.10 

10.90 

100 


% of Column 

59-97 

45.83 

58.02 

Failed 

n 

5 

8 

13 


% of Row 

38.46 

61.54 

100 


% of Column 

0-37 

3-70 

0.83 

Incomplete 

n 

535 

109 

644 


% of Row 

83.07 

16.93 

100 


% of Column 

39.66 

50.46 

41-15 

Total 

n 

1349 

216 

1565 


% of Row 

86.20 

13.80 

100 


% of Column 

100 

100 

100 


Grades can be grouped into three categories. Those who passed are those who fulfilled criteria to receive 
credit for the academic year. Those who failed are those denied credit for the academic year but who 
nevertheless attempted passing. Lastly those who failed because they did not attempt passing all required 
courses are designated as incomplete. 

Tables 4 and 5 reveal that the proportion of passing students in Ait History is different from that in 
Educational Sciences^. We also note that, depending on the academic year-level, the number of passing 
students is very different. Educational Sciences students enter studies in the discipline as third year 
undergraduates and at this academic year-level success in Art History is superior to that of students in 
Educational Sciences. These data, distributed across the tables in respect to the academic year-level in each 
discipline, indicate the importance of the two variables, academic year-level^] and discipline, in order to 
analyze student academic success. 


Table 6. End-of-year results related to response to the questionnaire 


Results 


No Response 

Responded 

Total 

Passed 

n 

866 

421 

1287 


% of Row 

67.29 

32.71 

100 


% of Column 

40.39 

61.10 

45-43 

Failed 

n 

265 

74 

339 


% of Row 

78.17 

21.83 

100 


% of Column 

12.36 

10.74 

11.97 

Incomplete 

n 

1013 

194 

1207 


% of Row 

83.93 

16.07 

100 
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% of Column 

47-25 

28.16 

42.61 

Total 

n 

2144 

689 

2833 


% of Row 

75-68 

24.32 

100 


% of Column 

100 

100 

100 


There is a significant relationship between the fact of responding to the questionnaire and the end-of-year 
results (X 2 (2)=94.99; pc.ooi; cf. Table 6). Table 6 reveals the higher proportion of students who did not 
complete all courses out of those who did not respond to the questionnaire. Also, students that did respond 
have a higher success rate than the others. Nevertheless, there is no significant relationship between the 
fact of having responded to the questionnaire and the discipline (X 2 (i)=. 82; ns) or the academic level 
(X 2 (3)=4.85; ns). The difference between students who responded to the questionnaire and the others 
may be interpreted as an inability to contact students who had abandoned their studies during the 
academic year for whatever reason (professional activity, change of program, discouragement etc.). This 
also suggests that respondents' data presented underestimates dropout rate. 

In terms of average year grades (only for those that completed all courses), there is a difference between 
disciplines F(i,i62i)=io.i5; pc.oi), and between the academic levels in the discipline (F(3,162:0=549.42; 
pc.ooi). As Table 7 indicates, means of students' average grade in first and second year present much 
lower means than third year undergraduate students. 


Table 7. End-of-year grade means related to academic level and discipline for all students 


Academic Level 

Discipline 

Mean 

SD 

n 

Licence 1 

Art History 

7-55 

4-51 

372 

Licence 2 

Art History 

7.02 

5-42 

224 

Licence 3 

Art History 

11.50 

1-45 

109 


Educational Sciences 

12-54 

1.48 

814 


Both AH and ES 

12.42 

1.51 

923 

Master 1 

Educational Sciences 

12.98 

2.09 

107 

Total 

Art History 

7-99 

4.76 

705 


Educational Sciences 

12.59 

1-57 

921 


Differences are mainly related to the first two undergraduate years in Art History. At a comparable level the 
differences apparent in Table 7 are much smaller. Apart from what can be seen in Table 7, there is a 
significant difference (F(i,i 624)=35.05; pc.ooi) between those who responded to the questionnaire 
(11.49) and those who did not (10.21)- 

Results of students who responded to the questionnaire 

Results analyzed in relation to receiving credit for the academic year 

There a significant relationship between the learning modality chosen by the student and the end-of-year 
results (X 2 (6)=92.43; pc.ooi). This dependency is explained mainly by the low rate of passers among the 
correspondence learners. Also to be noted is that more than half the students in that modality did not 
complete all their courses. 


Table 8. End-of-year results related to learning modality 


Learning Modality 

Results 

On-Campus Only 

Correspondence 

E-learning 

Combined Modes 

Total 

Passed 


n 

187 

45 

164 

23 

419 

% of Row 

4463 

10.74 

39-14 

5-49 

100 

% of Column 

69.78 

32-37 

63.08 

92.00 

60.55 

Failed 






n 

40 

20 

14 

0 

74 

% of Row 

54-05 

27-03 

18.92 

0 

100 

% of Column 

14-93 

14-39 

5-38 

0 

10.69 
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Incomplete 





n 

41 

74 

82 

2 

199 

% of Row 

20.60 

37-19 

41.21 

1.01 

100 

% of Column 

15-30 

53-24 

31-54 

8.00 

28.76 

Total 






n 

268 

139 

260 

25 

692 

% of Row 

38.73 

20.09 

37-57 

3-6 i 

100 

% of Column 

100 

100 100 

100 100 


We note that the correspondence modality presents problematic characteristics. Most students in this 
modality are in Art History (Table 1 and 2) in which scores are not as good as those of Educational Sciences 
students (Table 4 and 5). Also, out of the 139 students in this modality (Table 1 and 2) five used parallel 
on-campus support. Conclusions are veiy different when the distribution of results is looked at depending 
on students' discipline of study. In Art History there is a notable relationship between the chosen learning 
modality and the end of year result ( X 2 (4)=y2.y2; pc.001), while this is not the case in Educational 
Sciences (X 2 (6 )=io. 82; ns). In Art History the persistence of this effect is explained by the massive success 
of face-to-face students in comparison to those learning at a distance (Table 9). 


Table 9. End-of-year results related to learning modalities in Art History 


Learning Modality 

Results 

On-Campus Only 

Correspondence 

E-leaming 

Total 

Passed 





n 

91 

27 

12 

130 

% of Row 

70.00 

20.77 

9-23 

100 

% of Column 

61.90 

25.00 

21.82 

41.94 

Failed 





n 

39 

20 

12 

71 

% of Row 

54-93 

28.17 

16.90 

100 

% of Column 

26.53 

18.52 

21.82 

22.90 

Incomplete 





n 

17 

61 

31 

109 

% of Row 

15.60 

5596 

28.44 

100 

% of Column 

n.56 

5648 

56.36 

3516 

Total 





n 

147 

108 

55 

310 

% of Row 

47.42 

34.84 

17.74 

100 

% of Column 

100 

100 

100 

100 


Table 10. End-of-year results related to learning modalities in Educational Sciences 


Learning Modality 

Results 

On-Campus Only 

Correspondence 

E-leaming 

Combined Modes 

Total 

Passed 






n 

96 

18 

152 

23 

289 

% of Row 

33-22 

6.23 

52.60 

7.96 

100 
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% of Column 

79-34 

58.06 

74-15 

92.00 

75-65 

Failed 






n 

1 

0 

2 

O 

3 

% of Row 

33-33 

0.00 

66.67 

0.00 

100 

% of Column 

0.83 

0.00 

0.98 

0.00 

0.79 

Incomplete 






n 

24 

13 

51 

2 

90 

% of Row 

26.67 

14.44 

56.67 

2.22 

100 

% of Column 

19.83 

41.94 

24.88 

8.00 

23.56 

Total 






n 

121 

3i 

205 

25 

382 

% of Row 

31.68 

8.12 

53-66 

6.54 

100 

% of Column 

100 

100 

IOO 

100 

100 


In Educational Sciences we note that correspondence learners succeed less well than those who chose 
another learning modality (Table 10). However, considering the low number of students who failed (3 out 
of 382), we pursued with complementary analyses without accounting for them. This time the relationship 
becomes significant (X 2 (3)=10.23; pc.05) and can be interpreted in respect to students that used a 
distance learning mode (Table 11). In accordance with our hypothesis, e-learning students did better than 
correspondence students. 


Table 11. End-of-year results, not taking into account failed students, related to learning modalities in 

Educational Sciences 


Learning Modality 

Results 

On-Campus Only 

Correspondence 

E-leaming 

Combined Modes 

Total 

Passed 






n 

96 

18 

152 

23 

289 

% of Row 

33-22 

6.23 

52.60 

7.96 

100 

% of Column 

80.00 

58.06 

74.88 

92.00 

76.25 

Failed 






n 

24 

13 

51 

2 

90 

% of Row 

26.67 

14.44 

56.67 

2.22 

100 

% of Column 

20.00 

41.94 

25.12 

8.00 

23-75 

Total 






n 

120 

31 

203 

25 

379 

% of Row 

31-66 

8.18 

5356 

6.60 

100 

% of Column 

100 

100 

100 

100 

100 


Here too, differences between e-leaming students and correspondence students can be explained by other 
factors. Table 2 reveals that few correspondence learners had parallel on-campus courses, which was not 
the case for e-learning students. Overall in Educational Sciences, there is a significant relationship between 
the fact of having taken at least one on-campus course in respect to end-of-year results (X 2 (2)=8 i. 47; 
pc.001). 74% of students that had taken at least one course on campus passed, while only 44% did when 
they used distance learning only for all their courses. This result, in accordance with our hypotheses, seems 
to corroborate the idea that blending learning modes within or among courses in a program has a positive 
effect on student success. 

As we observed earlier (Table 2), students in Educational Sciences combined with their e-learning 
on-campus face-to-face learning, which was not the case for students in Art History (Table 1). Two of the 
modalities used in Educational Sciences are of particular interest as in both cases a significant relationship 
exists with end-of-year results. This is both true for correspondence students (X 2 (i)=4.3i; pc.05) and 
e-leaming students (X 2 (i)=4.is; pc.05). Again, we wish to underline that these results do not account for 
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students who failed. In both distance learning modalities, students who had some of their courses take 
place on the university premises did better. However, proportions are different. Correspondence learners 
who took on-campus courses all passed (5 out of 5, i.e. 100%; cf. Table 2); whereas, only half of the 
learners who took all their courses at a distance succeeded (13 out of 26, i.e. 50%; cf. Table 12). 70.1% of 
e-leaming students passed; whereas, 82.9% did when they took at least one course on campus too. It also 
seems that despite the fact that following at least one course on campus offers better prospects for passing, 
using e-learning for all of one's courses still renders better results than correspondence students and thus 
reduces the gap with results from the on-campus modality. A last series of analyses were conducted to 
pinpoint this hypothesis. In Art History, distance learners' results, whether correspondence or e-leaming, 
do not differ from on-campus ones (X 2 (2)=o.36; ns). In contrast to this in Educational Sciences, though 
there is no significant difference between on-campus results and distance learners' results in general 
(X 2 (i)=i. 02; ns), a significant difference is noticeable for e-learners in respect to the former (X 2 (i)= 3.92; 
p<.05). Table 12 reveals that this relationship is linked to superior success of students who use e-learning 
(70% as opposed to 50%). These analyses done on figures pertaining to studies in Education Sciences, 
seem to indicate that although e-leaming does not totally appease all eventually met difficulties resulting 
from working entirely at a distance, it does substantially limit their effect. 

Table 12. End-of-year results, without considering failed students, related to two distance learning 
modalities in Educational Sciences 



Correspondence 

E-leaming 

Total 

Passed 




n 

13 

89 

102 

% of Row 

12-75 

87-25 

100 

% of Column 

50.00 

70.08 

66.67 

Failed 




n 

13 

38 

51 

% of Row 

25-49 

74-51 

100 

% of Column 

50.00 

29.92 

33-33 

Total 




n 

26 

127 

153 

% of Row 

16.99 

83.01 

100 

% of Column 

100 

100 

100 


In respect to students attending their studies on campus, partly or fully, the question remains as to the 
effect of taking some courses on-line. An analysis of data pertaining to distant students who had followed 
at least one on-campus course and their distance learning modality, has enabled to establish that there is 
no significant relation between these two variables (X 2 (3)=4 .i 6; ns). The absence of relationship indicates 
that on-campus students who received credit for the academic year were not affected by having undertaken 
some of their studies via e-learning. This effect too, conforms with the hypotheses. The fact of having taken 
some courses on-line yields similar results as in the case of having attended all courses on the university 
premises. 

Analysis of end-of-year grade means 

Overall, a significant difference is noticeable between the various learning modalities (F(3,45i)=n.26; 
p<.ooi). As Table 13 indicates, correspondence students attained the lowest grades. At odds with this, 
surprisingly e-leaming students have higher grade means than on-campus students. One has to 
nevertheless be careful when interpreting these results as certain categories of students are 
over-represented in some modalities. Correspondence students are mainly studying Art History whereas in 
this discipline students have markedly lower grade means than Educational Sciences students. 
Complementary analyses taking into account the discipline and the academic level were therefore required 
in order to attain a higher analysis resolution. 


Table 13. Student means related to learning modality 



n 

Mean 

Standard Deviation 

On-Campus Only 

227 

11.26 

2.85 

Correspondence 

62 

10.37 

2.76 

E-learning 

143 

12.05 

2.22 

Combined 

23 

13-51 

1-39 

Total 

455 

11.50 

2.69 


A first analysis with the variables, discipline and modality, indicates that only the discipline is significant 
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(F(i,48o)=94.02; /x.ooi) 1 ' The modality is not significant, neither as simple effect nor interacts with the 
discipline (F(i,48o)=. 69; ns). A second analysis of variance using the variables, modality and academic 
level, indicates a significant difference for modality (F(2,4463=4.75; pc.01) as well as for academic level 
(F(2,4463=60.79; pc.001) but no interaction effect (F(4,4463=1.08; ns) [5] . The contradiction between 
these two sets is related to different groupings and to the fact of not accounting for certain categories of 
data. The differences in student numbers between the various academic levels, modalities and disciplines, 
undermine the possible interpretations. A further study at the level of academic disciplines should enable 
to bypass some of the inconsistencies. An analysis of variance between academic level and modality on data 
of Art History students only, shows that there is no effect related to the modality, neither as simple effect 
(F(2,1853=2.05; ns), nor as interaction (F(4 ,i8s)=. 37; ns). In Educational Sciences it is not possible to use 
the academic level variable because of the sparse number of students in first year Master's level. An 
analysis of variance using the modality variable only reveals that there is a significant difference in 
Educational Sciences (F(3,2603=4.55; p<.oi; cf. Table 14). 


Table 14. Student grade means in Educational Sciences related to learning modality 



n 

Mean 

Standard Deviation 

On-Campus Only 

97 

12.83 

1.31 

Correspondence 

18 

12.04 

1-50 

E-learning 

123 

1248 

1.62 

Combined 

23 

13-51 

1-39 

Total 

261 

12.67 

1.51 


Table 15. Student grade means in Art History related to academic level 


On-Campus 

Level 

Mean 

Standard Deviation 

n 

No 

Licence 1 

8.73 

3-52 

33 


Licence 2 

9.84 

2.60 

15 


Licence 3 

11.13 

1.17 

16 


Total 

9-59 

3.02 

64 

Yes 

Licence 1 

9.09 

3-50 

77 


Licence 2 

11.16 

1.60 

37 


Licence 3 

12.41 

1.40 

16 


Total 

10.09 

3.12 

130 

Total 

Licence 1 

8.98 

3-49 

110 


Licence 2 

10.78 

2.01 

52 


Licence 3 

11.77 

1-43 

32 


Total 

9-92 

3-09 

194 


Table 14 allows a relatively similar interpretation to the one previously realized on the whole population, 
with one notable difference. The mean grade of on-campus students is this time higher to that of e-learning 
students. An analysis of variance on the whole of the sample with the factor of having followed all courses 
at a distance (correspondence and e-learning), reveals a significant difference (F(3,4513=11.26; pc.ooi). 
We note that this difference is mainly related to the combined modes modality as the three other means 
(on-campus, correspondence and e-learning) are relatively similar to each other. Post hoc tests confirm 
that there is a significant difference only between correspondence and combined modes students 
(Turkey=i.46; pc.05). Other two by two comparisons all yield non significant relationships. 

Initial analysis of variance on Art History, between academic level and on-campus students variables 
reveals an academic level effect (F(2,1883=13.12; pc.ooi) and an on-campus modality effect 
(F(i,1883=4.04; pc.05). As Table 15 indicates, on-campus students' mean grades are better no matter their 
academic level. One cannot use the modality variable in this analysis because on-campus students in Art 
History did not combine their studies with other modes. In Educational Sciences though, data on 
combined modes is available. An analysis of variance with the distance modalities variable (F(i, 137)=.47; 
ns) and on-campus (F(i,1373=1.11; ns) do not reveal any significant difference^. This result indicates that 
in Educational Sciences, when students pass all their courses, the fact of them having taken courses at a 
distance (correspondence or e-learning) does not have a significant impact on their mean grades. 

Discussion 


The various analyses reveal that academic success interpreted at a general level is influenced by variables 
that may introduce distortions in a way that requires that they be subtly considered before properly 
inferring from data. The two most potent factors that may impact academic success for students in our 
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sample are the academic year level and the academic discipline. 

The first academic level, which is taken into account here in Art History only, has the lowest rate of 
students receiving credit for the academic year and the lowest mean for student grades. The fact that 
Educational Sciences students generally succeed better than those in Art History is explained by the fact 
that the former start their studies at the third undergraduate academic year, a level at which academic 
success is better in Art History too. 

In accordance with our hypotheses, taking into account both above-mentioned variables, academic success 
of students who took their courses entirely at a distance is not as good as that of on-campus students. 
Nevertheless, analyses conducted on Educational Sciences data reveal that the difference can be reduced. 
The fact of combining on-campus and distance learning modes within or among courses, positively affects 
academic success in terms of students receiving credit for the academic year in Educational Sciences. It 
should be pointed out that students' mean grades in Educational Sciences who were distance learners were 
clearly not as affected as students in Art History. The reduced difference for the former may be explained 
by the effect of combined modes. 

Another hypothesis that is validated by the tests we ran on Educational Sciences students, is the positive 
effect using a LCMS has on the rate of students receiving credit for the academic year. A higher rate of 
students that used e-learning passed their academic year in comparison to correspondence students in the 
same programs. In spite of this, similarly to the previous result, the positive effect does not show up in 
students' grade means, no doubt due to the same reasons as previously mentioned of absence of difference 
between grade means of on-campus and distance learning students. 

A last hypothesis was formulated in respect to differences in the way e-learning tools are used in theoretical 
sciences as opposed to applied sciences. This hypothesis cannot be validated by this study as no 
information pertaining to the direct use of the LCMS services was collected. However, a clear difference 
between the two disciplines as expressing the above-mentioned categories of sciences, is revealed in terms 
of student academic success with the two indicators used in this study. In Art History the fact of using the 
LCMS for distance learning has no effect in reducing the gap with on-campus students. In Educational 
Sciences however, the study reveals that using the LCMS significantly raised the success rate in 
comparison to correspondence students. 

All the analyses converge to indicate that e-learning's potential may have a positive impact on academic 
success for distance learners. Contrary to the illusion that predominated at the beginning of the years 
2000, and that was spread by the administration of large education institutions (Palloff and Pratt 2000), 
the simple fact of making technologies available does not produce a virtuous effect as such. Art History 
students' results clearly indicate that the introduction of e-learning had no positive effect on student 
academic success. The opposite is true in Educational Sciences, as we noted earlier. 

Be that as it may, one must not forget that different media have different impact on the contents depending 
on the domain. Art History relies more on images than Education Sciences, especially when it comes to 
representing paintings, architecture or sculpture for instance. Mediating artwork entails skills that are 
highly dependant on the used technologies. For Bates (1993) a distinction between media and technology 
is necessary. Media is a particular means for communication that is associated to a representation of 
knowledge. Each media therefore involves a form of representation and the organization of knowledge that 
is specific to it and that is tied to its format and representational mode. For example, the fade-out technique 
for transition between scenes in filmmaking is specific to the audio-visual media in use. A learner's 
interpretation of the meanings conveyed through techniques is therefore dependant on the media 
(Salomon & Cohen, 1977). This makes it clear that the mediation of Art History is far more sensitive to the 
media being used than Educational Sciences are. The interpretation of artwork is highly dependant on the 
media and technologies being used. As there was no specific adaptation of the LCMS to accommodate for 
the Art History course, it is also possible that academic success differences between the two domains in 
accountable to this. 

In regard to the complexity of data, which can mask the existence of hidden variables, one must be weary of 
the ecological validity and hence the extent of these conclusions. Furthermore, end-of-year grades are no 
doubt not the best guarantors for assessing educational effectiveness as Carre (2005) conceives it, for 
example. Nevertheless, the impact that e-learning has remains coherent with the conclusions of numerous 
other studies, such as those presented in the introduction (Fenouillet and Dero 2006). This makes it 
worthy of suggesting some directions for thought in respect to bettering learning systems that wish to 
incorporate distance learning. Firstly, it appears worthy for educational settings relying on distance 
learning to incorporate at least one face-to-face course (in modular programs). This should prove beneficial 
for student academic success. Secondly, the effect of e-learning depends on usage. At least, it cannot be 
attributed only to the media as it does not manifest itself in Art History. At this level our hypothesis is 
similar to Clark's (1985), attributing its effect to the course design that Educational Sciences instructors 
used. Several explanations can be pondered. In a qualitative study on LMS use in distance learning, 
Jezegou (2006) notes that for instructors, innovation is not perceived as the introduction of technologies 
in their practices. It is held to be the skills needed to spark and favor, at a distance, the cognitive and social 
engagement of students in collaborative activities. Said differently, it is no doubt insufficient to technically 
train instructors to use educational technologies. What is required is devising the most appropriate 
instructional design for the particular educational goal. Finally, it comes across that some software is better 
adapted to certain disciplines, as underlined by White and Liccardi (2006) through the use of the notion 
"technological affordance". It emerges as necessary to analyze practices that facilitate knowledge 
construction and that develop a learning dynamic (Carre 2005) by using advantageously a set of 
technological tools that are adapted to these goals. 

MeNFASE, developed in 2003 by Mo’ise Dero, Fabien Fenouillet and Yves Szymczak. 

t 2 l The sum of individuals is slightly under 2847 because of missing data for some students, as indicated 
earlier. 

tel Further on we will refer to year-level simply as level. 

[4] Combined modes students, who are only present in Educational Sciences, were grouped with 
on-campus students for his analysis. 

[5] Combined modes students, who are only present in Educational Sciences, were grouped with 
on-campus students for this analysis. Also, grades of Master level students were not used as they are only 
present in Educational Sciences. 

[6] Only these two modalities are accounted for. 
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